A Method for Forming Mutual Beliefs for Communication through Human-robot Multi-modal Interaction
نویسنده
چکیده
This paper describes a method of multimodal language processing that reflects experiences shared by people and robots. Through incremental online optimization in the process of interaction, the user and the robot form mutual beliefs represented by a stochastic model. Based on these mutual beliefs, the robot can interpret even fragmental and ambiguous utterances, and can act and generate utterances appropriate for a given situation.
منابع مشابه
Multi-Modal Interaction of Human and Home Robot in the Context of Room Map Generation
In robotics, the idea of human and robot interaction is receiving a lot of attention lately. In this paper, we describe a multi-modal system for generating a map of the environment through interaction of a human and home robot. This system enables people to teach a newcomer robot different attributes of objects and places in the room through speech commands and hand gestures. The robot learns a...
متن کاملMulti-modal human robot interaction for map generation
This paper describes an interface for multi modal human robot interaction, which enables people to introduce a newcomer robot about different attributes of objects and places in the room through speech commands and hand gestures. Robot makes an environment map of the room based on knowledge learned through communication with human and uses this map for navigation. The developed system consists ...
متن کاملA computational model of multi-modal grounding for human robot interaction
Dialog systems for mobile robots operating in the real world should enable mixedinitiative dialog style, handle multi-modal information involved in the communication and be relatively independent of the domain knowledge. Most dialog systems developed for mobile robots today, however, are often system-oriented and have limited capabilities. We present an agentbased dialog model that are speciall...
متن کاملSemi-Autonomous Robot Avatar as a Medium for Family Communication and Education
Robots as an embodied, multi-modal technology have great potential to be used as a new type of communication device. In this paper we outline our development of the Huggable robot as a semi-autonomous robot avatar for two specific types of remote interaction family communication and education. We also describe three different operator control interfaces (Web Interface, Wearable Interface, and S...
متن کاملLearning issues in a multi-modal robot-instruction scenario
One of the challenges for the realization of future intelligent robots is to design architectures which make user instruction of work tasks by interactive demonstration effective and convenient. A key prerequisite for enhancement of robot learning beyond the level of low-level skill acquisition is situated multi-modal communication. Currently, most existing robot platforms still have to advance...
متن کامل